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I  Introduction 

In  latent  trait  models  and  their  applications,  the  test  infcH'mation  function  has  an  important  role, 
and  has  proved  to  be  useful  in  many  ways.  Let  B  be  ability,  or  latent  trait,  which  assumes  any  real 
number.  We  assume  that  there  is  a  set  of  n  test  items  measuring  6  whose  characteristics  are  known. 
Let  g  denote  such  an  item,  be  a  discrete  item  response  to  item  g  ,  and  Pk,  (0)  denote  the 
operating  characteristic  of  kg  ,  or  the  conditional  probability  assigned  to  kg  ,  given  B  ,  Lt., 

(1.1)  P,,(e)=prob.[kg\B]  . 

We  assume  that  is  three-times  differentiable  with  respect  to  B  .  We  have  for  the  item  responte 

information  function  (Samejima,  1972) 

(1.2)  h,{e)  =  -^iogP*,(tf)  =  l^PkA«)  [PkAm-^  , 

and  the  ttem  tn/ormat«on /unction  is  defined  as  the  conditional  expectation  of  Ik,{6)  ■  given  $  ,  such 
that 

(1.3)  lg(6)  =  E[IkA0)  I  =  E  l4^*.(fi)PlP.,(«)l-‘  . 

k,  k. 

In  the  special  case  where  the  item  g  is  scored  dichotomously,  this  item  information  function  is  simplified 
to  become 

(1-4)  Ig(e)  =  1^  P,(e)p  \{Pg(e)){i  -  p,(»)}i-i  , 

where  Pg{8)  denotes  the  operating  characteristic  of  the  correct  answer  to  item  g  . 

Let  V  be  a  response  pattern  such  that 

(1-5)  V  =  {kgy  5=1,2 . n  . 


The  operating  characteristic,  iV  (0)  ,  of  the  response  patten  V  is  defined  as  the  conditional  probability 
of  V  ,  given  8  ,  and  by  virtue  of  local  independence  we  can  write 

(1-6)  A.(tf)=  n  • 

kftV 

The  response  pattern  information  function,  Iv(8)  ,  (Samejima,  1972)  is  given  by 

(1-7)  Jv  («)  =  -^  ^  (0  =  E  K  (^)  - 

k,tV 

and  the  test  information  function,  1(8)  ,  is  defined  as  the  conditional  expectation  of  ly  (^)  ,  given  8  , 
and  we  obtain  from  (1.2),  (1.3),  (1.5),  (1.6)  and  (1.7) 

(1.8)  1(8)  =  E\Iy  (8)  \8]  =  Yilv  («)iV  («)  =  Y,  • 

V  »=1 
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It  is  a  big  advantage  of  the  modern  mental  test  theory  over  classical  mental  test  theory  that  the 
standard  error  of  estimation  can  locally  be  defined  by  means  of  |/(^)]~*^^  «  which  does  not  depend 
upon  ike  population  of  examinees,  but  is  solely  a  property  of  the  test  itself.  In  computerised  adaptive 
testing,  for  example,  this  function  can  be  used  for  the  stopping  rule  indicating  the  desirable  accuracy 
of  estimation  of  the  examinee’s  ability  (cf.  Samejima,  1977b),  provided  that  our  itempool  contains  a 
large  number  of  items  whose  difficulty  levels  distribute  widely  over  the  range  of  6  of  interest. 

In  a  case  where  our  test  does  not  have  a  large  amount  of  information  for  the  entire  range  of  S  of 
interest,  however,  we  may  have  some  reservations  in  using  [I ss  a  measure  of  local  accuracy 
of  estimation  for  all  d  . 

It  has  been  shown  (Samejima,  1977a,  1977b)  that  in  many  cases  the  conditional  distribution  of  By  , 
given  6  ,  converges  to  N(6,  [/(^)J~^^^)  relatively  quickly.  On  the  other  hand,  we  have  also  noticed 
that  the  speed  of  convergence  is  not  the  same  even  if  the  amount  of  test  information  is  kept  equal.  This 
has  been  demonstrated  by  using  Constant  Information  Model  (Samejima,  1979a),  which  is  represented 
by 

(1.9)  Pj(tf)  =  sin^{a,(tf  -  fcj)  +  (x/4)l  , 

where,  as  before,  Pg{8)  denotes  the  operating  characteristic  of  the  correct  answer,  and  Og  (>  0)  and 
bg  are  the  item  discrimination  and  difficulty  parameters,  respectively.  This  model  provides  us  with  a 
constant  amount  of  item  information  Ig{ff]  which  equals  4a^  for  the  interval  of  6  , 

(1.10)  -  ir[4a,|~*  +  bg  <6  <  ir[4aj)~^  +  bg  . 

For  the  purpose  of  illustration,  Figures  1-1  and  1*2  present  part  of  the  results  obtained  by  using 
Monte  Carlo  studies  (cf.  Samejima,  1979b).  In  this  study,  twenty  hypothetical  tests  of  ten  to  two 
hundred  equivalent  items  with  the  common  parameters,  Og  =  0.25  and  bg  =  0.00  ,  were  ad¬ 
ministered  to  one  hundred  examinees  hypothesised  at  each  of  the  eight  different  levels  of  9  ,  i.e., 
6  =  —3.0, —2.2, —1.4,  —0.6,  0.2,  1.0,  1.8,  2.6  .  Thus  these  items  provide  us  with  the  same  amount  of 
constant  item  information,  0.25  ,  for  the  interval  of  8  , 

(1.11)  —  w  <  8  <  X  . 


In  these  figures,  the  results  of  ten  and  twenty  items  for  9  =  0.2  and  for  9  =  2.6  are  shown,  respectively. 
In  each  graph,  the  cumulative  frequency  ratio  of  the  maximum  likelihood  estimates  9y  's  of  the  one 
hundred  hypothetical  examinees,  the  asymptotic  normal  distribution  function  IV'(9,  [/(9)]~^/^)  and 
the  normal  distribution  function  using  the  sample  mean  and  standard  deviation  ot  the  one  hundred 
9v  's  as  the  two  parameters  are  presented.  These  figures  indicate  that,  even  when  the  number  of  items 
is  as  smaU  as  20  or  10  ,  the  normal  approximation  of  the  distribution  of  the  maximum  likelihood 
estimate  9v  works  well  when  the  level  <A  9  ix  close  to  the  common  difficulty  parameter  bg  ,  while 
the  convergence  is  much  slower  when  the  level  of  9  is  far  away  from  bg  .  Note  that  in  both  examples 
the  amounts  of  test  information  are  the  same,  i.e.,  I{9-,9  =  0.2)  =  I[9;9  =  2.6)  ,  which  equals  2.5  for 
the  ten  item  case  and  5.0  for  the  twenty  item  case. 

The  above  examples  indicate  that  in  certain  situations  a  test  does  not  provide  us  with  as  much 
amount  of  test  information  as  its  test  information  function  makes  us  believe  on  certain  levels  of  ability 
9  .  This  fact  suggests  that  we  need  to  be  careful,  and  in  some  cases  we  may  need  some  modification  of 
the  test  information  function. 


2 


Cumulative  Frequency  Ratio  of  '■  of  tke  Cue  Hundred  Hypothetical  Examinees  with 
Ability  Level,  f  ^  0.2  ,  (Step  FVmction),  the  Asymptotic  Normal  Distribution  Function 
N{9,  (Solid  Line)  and  the  Normal  Distribution  F^uiction  Using  the  Sample 

Mean  and  Standard  Deviation  of  l|r 's  As  the  Two  Parameters  (Dotted  Line). 

Thn  and  Twenty  Equivalent  Items  FoDowing  the  Constant  Information  Model 
with  a,  K  0.25  and  tg  «  0.00  Were  Administered,  Respectively,  in  the 
Two  Separate  Sessions. 


S 


FIGURE  1-2 

Gunfire  FVvqneacy  Ratio  of  ^  of  the  One  Hoadrad  Hypothetical  Exanuaeea  with 
Ability  Level,  t  =  2.9  ,  (Step  Fraction),  the  Aaymptotic  Nonnal  Dietribatioa  FSiactioa 
IH^)]  (Solid  Liae)  aad  the  Normal  Dietribatioa  F^ctioa  Ueiag  the  Sample 
hfeaa  aad  Staadard  Deviatioa  ot  tv 't  At  the  Two  Parametere  (Dotted  Liae). 

IWa  aad  Tweaty  Eqaivaleat  bema  FoDowiag  the  Coaetaat  laformatioa  Model 
with  w  0.25  aad  bg  *  0.00  Were  Admiaietered,  Reapectively,  ia  the 
Two  Separate  Seaakma. 
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The  present  paper  proposes  two  modification  formulae  of  the  test  information  function  I[6) ,  in  order 
to  provide  better  measures  of  local  accuracks  the  estimation  of  9  ,  when  the  maximum  likelihood 
estimation  is  used  to  provide  us  with  the  estimate  til  ability  6  . 


II  Minimum  Variance  Bound 

The  reciprocal  of  the  test  information  function  /(tf)  also  provides  us  with  a  minimum  variance 
bound  for  any  unhi<utd  estimator  of  9  (cf.  Kendall  and  Stuart,  1961).  Since  the  maximum  likelihood 
estimate,  which  is  denoted  by  9v  ,  it  only  atymptoticeUly  unbiased,  for  a  finite  number  of  items  we  need 
to  examine  if  the  bias  of  9y  of  a  given  test  over  the  meaningful  range  of  0  is  practically  nil,  before 
we  consider  this  reciprocal  as  a  minimum  variance  bound.  In  this  section  we  shall  consider  a  minimum 
variance  bound  which  applies  for  any  estimator  of  9  ,  biased  or  unbiased. 

Let  6y  denote  any  estimator  of  9  .  We  can  write  in  general 

(2.1)  E(9^  I  tf)  =  «  +  £{{9^  -  «)  I  . 


When  the  item  responses  are  discrete,  we  have 

(2.2)  £(«0  I  <>)  =  E  MS)  , 

V  V 

where  Lv(9)  denotes  the  likelihood  function.  Differentiating  both  sides  of  (2.2)  with  respect  to  6  , 
we  obtain 


(2.3) 


since  we  have 

(2.4) 

(2.5) 
and 


(2.6) 


We  can  write 
(2.7) 


§gm\s]  =  ^  lE  «v  /v(9)i  =  E  Sv\§gP^{s)] 

V  ° 

EM9)  =  1. 

V 

V 

E I «)  (<’))  =  I S)  E 1^^ (^)l  =  0  • 

^^V(»)  =  i^logiV(^))/V(«)  . 


and  using  this  we  can  rewrite  (2.3)  into  the  form 
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(2.8) 


^E^etr  I  «)  =  Kv  -  E(0tr  I  01  [^log  /V(0]  ^V(0  • 

FVom  this  result,  by  the  Cram4r-Rao  inequality,  we  obtain 

(2.9)  I  1 0  E[{jg  log  /V  (0)"  I  0  • 

Since  we  can  write 


(2.10)  ^^({^logi^(0}"  I  0\  =  -£?[^logLv(0  I  B]  , 

from  this,  (1.7),  (1.8)  and  (2.1)  we  can  rewrite  and  rearrange  the  inequality  (2.9)  into  the  form 

(2.11)  Var.(0^  1 0  >  [^E{e-y  I  1/(01"*  =  11  +  jgEietr  - e  i  oi*  1/(01"*  • 

The  rightest  hand  side  of  (2.11)  provides  us  with  the  minimum  variance  bound  of  the  conditional 
distribution  of  any  estimator  6^  .  When  is  an  unbiased  estimator  of  6  ,  the  second  term  of  the 
first  factor  equals  sero,  and  we  obtain  the  reciprocal  of  the  test  information  function  for  the  minimum 
variance  bound.  When  By  is  biased,  however,  the  sise  of  the  minimum  variance  bound  is  determined 
by  this  second  term,  and  it  can  be  greater  or  less  than  the  reciprocal  of  the  test  information  function 
depending  upon  the  sign  of  this  partial  derivative. 


Ill  First  Modified  Test  Information  Function 

Lord  has  proposed  a  bias  function  for  the  maximum  likelihood  estimate  of  9  in  the  three-parameter 
logistic  model  whose  operating  characteristic  of  the  correct  answer,  Pg[B)  ,  is  given  by 

(3.1)  Pg[B)  =  Ca-^-(l-CJ)(l-^exp{-I>Op(^-6p)}]■*  , 

where  Og  ,  bg  ,  and  Cg  are  the  item  discrimination,  difficulty,  and  guessing  parameters,  and  27  is  a 
scaling  factor,  which  is  set  equal  to  1.7  when  the  logistic  model  is  used  as  a  substitute  for  the  normal 
ogive  model.  Lord’s  bias  function  B{8y  |  B)  can  be  written  as 

(3.2)  B(Bv\B)  =  D\m\-^j2agIg{B)\UB)-\\  . 


where 

(3.3)  i>g{B)  =  ll  +  «xp{-27a,(tf-6j)}]"* 


(cf.  Lord,  1983).  We  can  see  in  the  above  formula  of  the  MLE  bias  function  that  the  bias  should  be 
negative  when  ^l>g[B)  is  less  than  0.5  for  all  the  items,  which  is  necessarily  the  case  for  lower  values  of 
B  ,  and  should  be  positive  when  ^0($)  is  greater  than  0.5  for  aU  the  items,  i.e.,  for  higher  values  oi  $  , 
and  in  between  the  bias  tends  to  be  close  to  sero,  for  the  last  factor  in  the  formula  assumes  negative 
values  for  some  items  and  positive  values  for  some  others,  provided  that  the  difficulty  parameter  bg 
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distributes  widely.  Lord  has  applied  this  MLE  bias  function  for  an  85-item  SAT  Verbal  test  (Lord, 
1984),  and  the  result  shows  a  wide  range  of  ^  in  which  the  bias  is  practically  niL 

In  the  general  case  of  discrete  item  responses,  we  obtain  for  the  bias  function  of  the  maximum 
likelihood  estimate  (cf.  Samejima,  1987) 

(3.4)  B(ffy  I  e)  =  -eie]  =  -(i/2)(/(«)]-=« 

B=1  k, 

B=1  k, 

where  Ak,  [6)  is  the  basic  function  for  the  discrete  item  response  kg  ,  and  Pj^  (9)  and  {6)  denote 
the  first  and  second  partical  derivatives  of  Pk,{9)  with  respect  to  6  ,  respectively.  On  the  graded 
response  level  where  item  score  Xg  assumes  successive  integers,  0  through  mg  ,  each  kg  in  the 
above  formula  must  be  replaced  by  the  graded  item  score  Xg  (cf.  Samejima,  1969,  1972).  On  the 
dichotomous  response  level,  it  can  be  reduced  to  the  form 

(3.5)  B(ey\e)  =  E[§v-e\e]  =  (-■L/2)\m]-^'£ig[e)p'^'{e)[p^(e)]-^  , 

0=1 

with  Pg(S)  and  Pg{B)  indicating  the  first  and  second  partial  derivatives  of  Pg{ff)  with  respect  to 
S  ,  respectively.  This  formula  includes  Lord’s  bias  function  in  the  three-parameter  logistic  model  as  a 
special  case. 

We  can  rewrite  the  inequality  (2.11)  for  the  maximum  likelihood  estimate  §v 

(3.6)  Var.{§y  |  #)  >  [1  +  ^B{§y  |  O)]^  [/(?)]-»  . 

Taking  the  reciprocal  of  the  right  hand  side  of  (3.6),  which  is  an  approximate  minimum  variance  bound 
of  the  maximum  likelihood  estimator,  a  modified  test  information  function,  T($)  ,  can  be  defined  by 

(3.7)  T(e)  =  i(e)\i  +  j^B(0y\0)]-^  . 

FVom  this  formula,  we  can  see  that  the  relationship  between  this  new  function  and  the  original  test 
information  function  depends  upon  the  first  derivative  of  the  MLE  bias  function.  To  be  more  precise, 
if  the  derivative  is  positive,  then  the  new  function  will  assume  a  lesser  value  than  the  original  test 
information  function.  If  it  is  negative,  then  this  relationship  will  be  reversed.  If  it  is  sero,  i.e.,  if  the 
MLE  is  unbiased,  then  these  two  functions  will  assume  the  same  value.  We  can  write  from  (3.4)  for  the 
general  form  of  the  derivative  of  the  MLE  bias  function 

(3.8)  ^B(§y  1 6)  =  {/(tf)}-‘[(i/2){/(«)}-* - n,(«)Pk:m{Pk,m-^) 

8=1  k, 

-2B(ey  I  tf)/'(0)I  , 

where  P{c"{9)  and  l'{6)  denote  the  third  and  the  first  derivatives  of  Pk,(B)  and  1(9)  with  respect 
to  9  ,  respectively.  It  is  obvious  from  (1.3)  and  (1.8)  that  we  have 
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m  =  Y,  -  hAe)] 

kg 

(3.10)  r(tf)  =  Y  W  =  EE  -  A.(«)i  , 

g=l  g=l  k, 

where  Ig{^)  i*  derivative  of  the  item  information  function  Ig(8)  with  respect  to  8  .  For  a 

set  of  dichotomous  items  (3.8)  becomes  simplified  into  the  form 

(3.11)  ^B{ev  I  8)  =  {/(0)}-M(i/2){/(fl)}-^  E{JV(«)}-=*{1  -  Pg{e))-^ 

g=l 

({1  -  2Pg(8)}{p‘Ae)}^pi,'{8)  -  PAm  -  + p'gm'im 

-2B(6v  I  8)  /'(«)]  . 
where  B{8v  \  8)  is  given  by  (3.5). 


(3.9) 

and 


IV  Minimum  Bound  of  the  Mean  Squared  Error 

When  the  estimator  8y  is  conditionally  biased,  however  smaU  the  conditional  variance  may  be,  it 
does  not  reflect  the  accuracy  of  estimation  of  8  .  Thus  the  mean  squared  error,  E\{8y  —  8)^  {  0]  , 
becomes  a  more  important  indicator  of  the  accuracy.  We  can  write  for  the  mean  squared  error 

(4.1)  £l(8:r  -  I  5]  =  Var.(8C-  |  8)  +  |£;(«^  |  8)  -  8}^ 

(cf.  Kendall  and  Stuart,  1961).  We  can  see  in  this  formula  that  the  mean  squared  error  equals  the 
conditional  variance  if  is  unbiased,  and  is  greater  than  the  variance  when  8y  is  biased.  FVom  this 
and  the  inequality  (2.11)  we  obtaiin  for  the  minimum  bound  of  the  mean  squared  error 

(4.2)  -  8)^  I  >  [1  +  £f(8^  -  8  I  e)f  f/((?)l-*  +  \E[8;,  \  8)  -  8\^  . 

Note  that  this  inequality  holds  for  any  estimator,  8y  ,  ol  8  . 


V  Second  Modified  Test  Information  Function 

For  the  maximum  likelihood  estimate  8v  ,  we  can  rewrite  the  inequality  (4.2)  by  using  the  MLE 
bias  function,  which  is  given  by  (3.4),  to  obtain 

(5.1)  EH6v  -  8)^  I  >  [1  +  ^B{8y  I  8)]^  [/(<»)]->  +  {B{ev  ]  tf)p  . 

Taking  the  reciprocal  of  the  right  hand  side  of  (5.1),  which  is  an  approximate  minimum  bound  of  the 
mean  squared  error  of  the  maximum  likelihood  estimator,  the  second  modified  test  information  function, 
S(0)  ,  is  proposed  by 
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(5.2) 


S(»)  =  1(0)  {(1  +  I  6)]^  +  m  [B(§v  1  • 

We  can  see  that  the  difference  between  the  two  modification  formuae  of  the  test  information  function, 
which  are  defined  by  (3.7)  and  (5.2),  respectively,  is  the  second  and  last  term  in  the  braces  of  the  right 
hand  side  of  the  formula  (5.2).  Since  this  term  is  nonnegative,  there  is  a  relationship 

(5.3)  E(fl)<T(fi)  , 

throughout  the  whole  range  of  6  ,  regardless  of  the  slope  of  the  MLE  bias  function.  If  there  is  a  range 
of  8  where  the  maximum  likelihood  estimate  is  unbiased,  then  we  will  have 

(5.4)  E(0)  =  r(8)^m  . 

Since  under  a  general  condition  the  maximum  likelihood  estimator  §v  is  asymptotically  unbiased  as 
the  number  of  items  approaches  positive  infinity,  (5.4)  holds  asymptotically  for  aU  6  . 

VI  Examples 

Samejima  has  applied  formula  (3.5)  for  the  MLE  bias  functions  of  the  Iowa  Level  11  Vocabulary 
Subtest  and  Shiba’s  Test  Jl  of  Word/Phrase  Comprehension,  based  upon  the  set  of  data  collected  for 
2,356  and  2,259  subjects,  respectively.  These  tests  have  forty-three  and  fifty-five  dichotomously  scored 
items,  respectively,  amd  following  the  normal  ogive  model,  whose  operating  characteristic  for  the  correct 
answer  is  given  by 

(6.1)  P,(8)  =  (2x1-1/=*  /  /*  du  , 

the  discrimination  and  difficulty  parameters  were  estimated  (Samejima,  1984a,  1984b).  Tables  6-1  and 
6-2  present  those  estimated  item  parameters.  The  resulting  MLE  bias  functions  are  illustrated  in  Figure 
6-1.  We  can  see  that  in  each  of  these  two  examples  there  is  a  wide  range  of  0  ,  i.e.,  approximately 
(-2.0,  1.5),  for  which  the  maximum  likelihood  estimate  of  $  is  practically  unbiased.  The  amount  of 
bias  is  especially  small  for  Shiba’s  Test  Jl.  Although  this  feature  indicates  good  qualities  of  these  tests, 
we  still  have  to  expect  some  biases  when  these  tests  are  administered  to  groups  of  examinees  whose 
ability  distributes  on  the  relatively  lower  side  or  on  the  relatively  higher  side  of  the  ability  scale. 

When  the  MLE  bias  function  of  the  test  is  monotone  increasing,  as  are  those  illustrated  in  Figure  6-1, 
it  is  obvious  from  (3.7)  that  T(^)  will  assume  lesser  values  than  those  of  the  original  test  information 
function  1(0)  for  lower  and  higher  levels  of  0  ,  while  these  two  functions  are  practically  identical  in 
between.  The  same  applies  to  S(^)  ,  and  we  have  the  relationship, 

(6.2)  S(^)  <  T(tf)  < /(^)  , 
throughout  the  whole  range  of  0  . 

Differentiating  (6.1)  twice  with  respect  to  0  and  rearranging,  we  obtain 
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TABLE  fr-l 


Ettimaied  Item  Diiciiiniiiation  Parameter  &g  and  Item  Difficnlty  Parameter  ig  for  Each 
of  the  Forty-Three  Dichotomooa  Teat  Items  of  the  Level  11  Vocabniary  Snbteat  of  the  Iowa 
Tests  of  Basic  Skills,  Based  npon  the  Resolts  CoDected  for  2,356  School  Children  of 

Approximately  Age  Eleven. 


Item 

9 

Discrimination 

Parameter 

Difficulty 

Parameter 

K 

24 

0.196 

-4.257 

25 

0.829 

•1.000 

26 

0.614 

•0.821 

27 

0.594 

•0.340 

28 

0.669 

•0.900 

29 

0.867 

•1.077 

SO 

0.956 

-0.557 

31 

0.938 

-0.179 

32 

0.940 

•0.803 

33 

0.434 

•2.331 

34 

0.598 

•1.210 

35 

0.489 

•0.569 

36 

0.657 

•0.987 

37 

0.351 

0.577 

38 

0.665 

•0.468 

39 

0.333 

•0.676 

40 

0.683 

0.402 

41 

0.531 

•0.948 

42 

0.436 

0.258 

43 

0.672 

-0.867 

44 

0.143 

4.175 

45 

0.898 

-0.357 

Item 

9 

Discrimination 

Parameter 

Difficnlty 

Parameter 

K 

46 

0.612 

•0.318 

47 

0.494 

-0.781 

48 

0.849 

0.054 

49 

0.421 

-0.626 

50 

0.346 

•0.250 

51 

0.664 

•0.420 

52 

0.640 

0.217 

53 

0.402 

0.526 

54 

0.573 

0.126 

55 

0.667 

•0.342 

56 

0.593 

1.007 

57 

0.370 

0.398 

58 

0.416 

0.782 

59 

0.491 

-0.731 

60 

0.678 

•0.170 

61 

0.519 

0.748 

62 

0.938 

-0.485 

63 

0.637 

•0.398 

64 

0.818 

•0.042 

65 

0.606 

0.595 

66 

0.604 

-0.376 
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TABLE  6-2 


Estimated  Item  Ducrimmation  Parameter  ftg  and  Item  DifiBcolty  Parameter  tg  for  Each 
of  the  Fifty-Five  Dkhotomoos  Test  Items  of  Test  Jl  of  Shiba's  Word/Phrase  Comprehension 
Tests,  Based  upon  the  Results  Collected  for  2,259  Junior  High  School  Students. 


Item 

9 

Discrimination 

Parameter 

is 

Difficulty 

Parameter 

Item 

9 

Discrimination 

Parameter 

4. 

Difficulty 

Parameter 

K 

JlOl 

0.726 

4).238 

J129 

0.761 

1.416 

J102 

0.537 

-0.956 

J130 

0.351 

-1.839 

J103 

0.568 

•1.263 

J131 

0.798 

-0.494 

J104 

0.710 

-0.809 

J1S2 

0.322 

0.162 

JIOS 

0.794 

-0.097 

J133 

0.822 

-1.377 

J106 

0.495 

-0.741 

J134 

0.302 

1.633 

J107 

0.583 

0.205 

J135 

0.850 

-0.225 

J108 

0.771 

-1.974 

J136 

0.368 

0.264 

J109 

0.386 

•0.872 

J137 

0.591 

0.331 

JllO 

0.572 

-0.327 

J138 

— 

— 

Jill 

0.950 

•1.266 

J139 

0.376 

1.602 

J112 

0.437 

•1.036 

J140 

0.422 

0.216 

JUS 

0.508 

•1.061 

J141 

0.666 

-0.689 

J114 

0.472 

0.486 

J142 

0.447 

0.132 

J115 

0.704 

-0.224 

J143 

0.686 

-0.100 

J116 

0.303 

-1.671 

J144 

0.384 

-0.399 

J117 

0.390 

•0.626 

J145 

0.630 

•0.479 

J118 

0.683 

-1.673 

J146 

0.880 

0.067 

J119 

0.653 

-0.972 

J147 

0.333 

0.374 

J120 

0.293 

1.068 

J148 

0.521 

-0.062 

J121 

0.470 

•0.904 

J149 

0.509 

-0.108 

J122 

0.461 

•1.038 

J160 

0.612 

-0.040 

J123 

0.466 

0.161 

J151 

0.462 

0.907 

J124 

0.662 

-1.313 

J162 

0.394 

0.478 

J125 

0.450 

-1.691 

J163 

0.384 

2.029 

J126 

0.367 

•0.424 

JI64 

a342 

2.363 

J127 

0.626 

-1.299 

J166 

0.738 

1.268 

J128 

0.679 

-1J)94 

J166 

a666 

1.468 
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MLE  BIAS  FUNCTION 


ONUOMl;  IOWA  VOCAMILAKY,  LEVEL  11;  NOIMAL  OQVE  MODEL; 


mmm 


THETA 

iJDoao.sai  AO  «!»«.« 

OOOIHLE  n»T.  ■■noE  IIIMHI  by  NANCY  DOMM 


FIGURE  6-1 

MLE  Bim  Fonctiona  of  the  Iowa  Level  11  Vocabulary  Snbteet  (Solid  Line)  and  of  Shiba's 
Teat  Jl  of  Word/Phraae  Comprehenaion  (Daahed  Line),  Following  the  Normal 

Ogive  Model 
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ONUMtl;  IOWA  VOCABUUIY,  Um  U;  NOUUL  OGIVK  MOMCL;  MN:  MOrm 


- •q.n.t.i.f. 

- aq.rt.,lst  mod.t.i.f. 

. •q.rt,2nd  inod.Li.f. 


SORT  OF  TEST  INFORMATION 


CMUtSMl;  IHIBA  WOU>  nST.  Jli  NOUUL  OdVl  MODEL;  «MI:  (MT/N 


THETA 


•iTioojotJOEaotjao 
■DAT.  I 


tferWWCVOOMM 


FIGURE  ft-3 

Squire  RooU  of  the  Originil  (Solid  Lme)  and  the  Two  Modified  (Dadied  and  Dotted  Lines) 
Test  Information  Fttnctiona  of  Shiba’s  Test  Jl  of  Woid/Phraae  Compnhenaion, 
FoOowing  the  Normal  Ogive  Model 
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(6.3) 

«nd 


Pi{9)  =  expI-(l/2)  al{9  -  i.)*] 


(6.4) 


Substituting  (6.3)  and  (6.4)  into  (3.5)  and  rearranging,  we  can  write  for  the  MLE  bias  function  following 
the  normal  ogive  model  on  the  dichotomous  response  level 

(6.5)  B{9v  1  tf)  =  (1/2)  [/(<?))-=»  al{9  -  b„)  I,[9)  . 

11=1 

Differentiating  (6.5)  with  respect  to  ^  ,  we  obtain 

(6.6)  ^B{9v  1  9)  =  (/(«)r’[(l/2)  j2  “2  l^i(^)(«  -  M  +  /»(«)) 

g=l 

-[/(tf)r  m  E  “s(^-M^«(«)i- 

a=i 


It  is  obvious  from  (1.4)i  (1.8)  and  (6.6)  that  we  have 

(6.7)  rj9]  =  1,(9)  IP'(9)  {2P,(9)  -  1}  (P,((?){l  -  P„(tf)})-i  -  2o*(^  -  6„)) 
and 

(6.8)  r(9)  =  1,(9)  \P‘,(9)  {2P,(9)  -  1}  (P^(^){1  -  P„(5)})-*  -  2a=(S  -  b,)]  . 

0=1 

Figures  6-2  and  6-3  show  the  square  roots  of  the  original  and  the  two  modified  test  information  func¬ 
tions  for  the  Iowa  Level  11  Vocabulary  Subtest  and  Shiba’s  Test  J1  of  Word/Phrase  Comprehension, 
respectively,  following  the  normal  ogive  model.  In  each  of  these  figures,  the  curves  respresenting  the 
results  of  the  two  modification  formulae  assume  lower  values  than  the  square  root  of  the  original  test 
information  function  for  all  9  ,  »»  was  expected  from  the  shape  of  the  MLE  bias  function  in  Figure 
6-1.  The  discrepancies  between  the  results  of  the  two  modification  formulae  are  small,  however,  in  each 
figure. 

In  the  three-parameter  logistic  model,  the  operating  characteristic  of  the  correct  answer  is  given  by 
the  formula  (3.1),  and  Lord's  MLE  bias  function  for  the  three-parameter  logistic  model,  which  is  given 
by  (3.2),  is  readily  applicable.  Differentiating  (3.1)  three  times  with  respect  to  9  and  rearranging,  we 
can  write 

(«•«)  n(«)  =  (1  - 's)  Oa,  i,,(9)  11  -  i>M  . 


(6.10)  P','(9)  =  (1  -  e,)  D^al  %(9)  (1  -  ^,(^)J  (1  -  2^,(^)1  =  Da,  P’,(9)\l  ~  2^,(tf)] 


and 
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(6.11)  P‘'>(9)  =  D^al  P',(9)[\  -  . 

where  i>g(9)  is  defined  by  (3.3).  Substituting  (6.9)  into  (1.4)  and  rearranging,  we  obtain  for  the  item 
information  function 

(6.12)  Ig(9)  =  (1  -  cg)  {i>g(9)}^  |1  -  ^,(fl)]  [c,  +  (1  -  Cg)  ^(tf)]-‘  . 

This  and  (1.8)  will  enable  us  to  evaluate  Lord’s  MLE  bias  function  given  by  (3.2).  Differentiating 
(3.2)  with  respect  to  9  and  rearranging,  we  can  write 

(6.13)  ±B[9v  \e)  =  D  {/(«)}-^lf;  ««  -  (1/2)} 

tf=l 

gssl 

-  2  m  {/(«)}-»  ag  Ig(9]  {rl>g{9)  -  (1/2)}]  . 

«=i 

FVom  (1.4),  (3.1)  and  (1.8)  we  obtain  for  the  first  derivatives  of  the  item  and  the  test  information 
functions  with  respect  to  9 

(614)  rg(9)  =  (l-c„)D\M^«(«)}’|l-\frs(^)!{/’s(m"‘ 

12  -  BUO)  -  (1  -  Cg)  -  ^s(^)}{^»('’)}-'l 

=  Dag  Ig(9)  (2(1  -  rl,g{9)}  -  ^,(tf){P,(S)}-N 

and 

(615)  m  =  D'£ag  Ig{9)  (2(1  -  ,t,(tf)}  -  M9){Pg{9)}-^]  , 

and  we  can  use  these  two  results  in  (6.13)  in  order  to  evaluate  ^B[9v  |  S)  . 

When  Cg  =  0  ,  i.e.,  for  the  original  logistic  model  on  the  dichotomous  response  level,  these  formulae 
become  much  more  simplified,  and  we  can  write 

(616)  P,(9)  =  ll  +  exp(-I>a,(ll-t,)})-»  =  V-,(fl)  , 

(617)  P!,(9)  =Dagfl,g{9){l-i>g{»)]  , 

(6.18)  J^'(fl)  =  D»oJ  ^,(0)  [1  -  ^,(8)1  (1  -  2^,(«)1  =  Dag  i^,(9)ll  -  2^,(9))  , 

(6.19)  /^«(9)  =  D^al  ^g{9)  [1  -  ^,(9)1  [1  -  60,(9)  +  6{0,(9)}")  , 
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MLE  BIAS  FUNCTION 


ONUMU;  IOWA  VOCABULAKT,  LKVIL  U;  IBIBA  wots  TOT.  Jl;  LOCnnC  MODBL;  Wr:  Mni/M 


THETA 

isaoojoiAoe.ao«.oa 

■MIMLESAT.  MH07.  pMM  w  nancy  OOMM 


FIGURE  6-4 


MLE  Bit!  Fniictiona  of  the  lowt  Levd  11  Voctbtlary  Sabtot  (Solid  Line)  and  of  Shibt* 
Taet  J1  of  Word/Phraae  Compreheuion  (Dtalied  Line),  FoDoering  the  Logistic  Model 


SORT  OF  TEST  INFORMATION 


omuwi;  IOWA  VOCABUIJUtT.  LEVEL  II;  LOCUnC  MODEL;  MR:  WttlM 


THETA 


•lMOqjdijoAjKUO 

■OTNOLiMT.  MHO?.  pMM  tr  NMCr  OOMM 

FIGURE  &*5 


Square  Root*  ot  the  Original  (Solid  Line)  and  the  Two  hfodified  (Daahed  and  Dotted  Lines) 
Test  Information  Pactions  of  the  Iowa  Level  11  Vocabnlary  Snbtest,  Following 

the  Logistic  Model. 


SORT  OF  TEST  INFORMATION 


ONUMPl;  IHDA  WOBD  mT,  Jl{  UXnsnC  MODEL;  M«:  MOM* 


THETA 


a.7SB0JSo\JU$jao*M 

«viWMUMkT.Mnn.fMMt*NMCi<raaMM 


FIGURE  0-e 

Sqnare  Roota  of  the  Original  (Solid  Line)  and  the  Two  Modified  (Daahed  and  Dotted  Linea) 
Teat  Information  Fhnctiona  of  Shiba’a  Tiat  J1  of  Word/Phraae  Comprehenaion, 
Fbllowiag  the  Logiatic  Model. 
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(6.20) 

= -D'o?  (1- 

(6.21) 

It 

& 

«  <a 

« 

1 

=  DagIg(S)  [l-2rPg{e)] 

(6.22) 

m  = 

a*  ipgle)  (1  -  V>s(^)l 

sisl 

and 

n 

(6.23) 

m  = 

E  Ar(«)  (1 

-2rPg[e)]  , 

tf=l 


respectively.  Thus  the  two  modified  test  information  functions,  T(0)  and  S(0)  ,  which  are  defined  by 
(3.7)  and  (5.2),  respectively,  can  be  evaluated  accodingly,  both  for  the  original  logistic  model  and  for 
the  three-parameter  logistic  model. 

Figures  6-4  through  6-6  present  the  MLE  bias  functions  and  the  square  roots  of  the  original  and 
the  two  modified  test  information  functions  for  the  Iowa  Level  11  Vocabulary  Subtest  and  Shiba’s  Test 
Jl  of  Word/Phrase  Comprehension,  respectively,  following  the  logistic  model  by  using  the  same  sets  of 
estimated  item  parameters  shown  in  Tables  6-1  and  6-2,  and  setting  D  =  1.7  .  These  results  are  similar 
to  those  following  the  normal  ogive  model,  which  are  presented  by  Figures  6-1  through  6-3,  except  that 
the  square  roots  of  the  original  and  the  modified  test  information  functions  are  a  little  steeper,  the 
characteristic  of  the  logistic  model  in  comparison  with  the  normal  ogive  model. 

In  the  homogeneous  case  of  the  graded  response  level  (Samejima,  1969,  1972),  the  general  formula 
for  the  operating  characteristic  of  the  item  score  Xg  (=  0, 1 . rrig)  is  given  by 


(6.24) 

where 

(6.25) 

»/-“00 

(6.26) 

—  oo  =  bo  <  bi  <  bj  <  ...  <  b„^  <  bm^+i 

and  4>g(t]  is  some  specified  density  function.  When  we  replace  the  right  hand  side  of  (6.25)  by  that 
of  (6.1)  with  bg  replaced  by  and  use  the  result  in  (6.24),  we  have  the  operating  characteristic  of 
Xg  in  the  normal  ogive  model  on  the  graded  response  level;  when  we  do  the  same  thing  using  the  right 
hand  side  of  (3.3),  we  obtain  the  operating  characteristic  of  in  the  logistic  model  on  the  graded 
response  level. 

Table  6-3  presents  the  item  discrimination  parameter  Og  and  the  two  item  difficulty  parameters, 
is,  for  X,  =  1, 2  ,  for  each  of  the  thirty-five  hypothetical  graded  items.  This  hypothetical  test  gives  an 
approximately  constant  amount  of  test  information  for  the  interval  of  fi  ,  (-3,  3).  Figure  6-7  presents 
the  MLE  bias  function  for  this  hypothetical  test,  following  the  normal  ogive  model  and  the  logistic 
model  on  the  graded  response  level,  respectively.  We  can  see  that  a  practical  unbiasedness  holds  for 
a  very  wide  range  of  0  in  both  cases,  as  is  expected  In’  a  set  of  graded  test  items  whose  response 
difficulty  levels  are  widely  distributed,  an  advantage  the  graded  response  item  over  the  dichotomous 
response  item.  We  also  notice  that  these  two  MLE  bias  functions  are  almost  indistinguishable  &om 
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MLE  BIAS  FUNCTION 


ONUtMn;  HYMTSmCAL  Tm;  Locnnc  MODU,  NOMUL  OGIVK  M(M>EL;  MOT/N 


5.0 

4.0 

3.0 

2.0 


—  Hypothetical  Test,  Normal  Ogive 
- Hypothetical  Test,  Logistic 


1.0  - 

0.0  ;=— - - - 

-1.0  - 
-2.0  - 
-3.0  - 
-4.0  - 

-5  Ql  I  ^  I  .  I  1—1  1  1,1  I 

-5.0  -4.0  -3.0  -2.0  -1.0  0.0  1.0  2.0  3.0  4.0  5.0 

THETA 

iA»o.nijoeaoeaa 

a07MIL£.CMT,  MSOTe  pMM  br  NANCY  OOUM 


FIGURE  6-7 

MLE  Bias  Ftuctioas  of  the  Hypothetical  Test  of  Thirty-Five  Graded  That  Items  Fbllowing 
the  Normal  Ogive  Model  (Solid  Line)  and  the  L^tk  Model  (Dashed  Line). 
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SORT  OF  TEST  INFORMATION 


ONUNn;  BYKTHmCAL  TEST;  NOtMAL  OGIVK  MODEL;  MHb  M»/M 
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FIGURE  6-8 


SqoEre  RooU  the  Origiii«l  (Solid  Line)  End  the  Two  Modified  (DEthed  End  Dotted  Lines) 
Test  InformEtion  FVinctions  the  HypotheticEl  Test  ot  Thirty-Five  Grsded  Test  Items 
Following  the  Nonnsl  Ogive  Model 


SORT  OF  TEST  INFORMATION 


ONuuwij  BvroTBrnoa  mr;  locuhc  model;  mm-,  mmm 
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FIGURE  6-0 

Square  Roots  the  Original  (Solid  Line)  and  the  Two  Modified  (Daahed  and  Dotted  Lines) 
Test  Information  F^inctions  of  the  Hypothetical  Tmt  of  Thirty-Five  Graded  That  Items 

Following  the  Logistic  Model. 
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tkc  Logktk  Model  with  a,  =  1.0  end  hg  s  0.0  Am  the  Common  Perametere. 
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SORT  OF  TEST  INFORMATION 


ONUMtl;  BYNrniniCAL  TOTi  LOGimC  MODILt  MWi  MTHM 
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FIGURE  6-11 

Sqaare  RooU  of  the  Original  (Solid  Line)  and  the  Two  Modified  (Daahed  and  Dotted  Linea) 
Teat  Information  IVuctiona  the  Hypothetical  TMt  of  Thirty  Equivalent  Itema  Following 
the  Logietk  Model  with  a,  »  1.0  and  h,  «  0.0  Aa  the  Commcm  Parameters. 
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each  other.  Figures  6-8  and  6-9  present  the  square  roots  of  the  original  and  the  two  modified  test 
information  functions  of  this  hypothetical  test  of  graded  items,  following  the  normal  ogive  model  and 
the  logistic  model,  respectively.  As  is  expected,  the  differences  among  the  three  functions  are  small  for 
a  wide  range  of  8  in  both  cases.  It  is  interesting  to  note,  however,  that  in  these  figures  the  square  roots 
of  the  modified  test  information  functions  assume  higher  values  than  the  square  root  of  the  original  test 
information  function  at  certain  points  of  0  ,  and  this  tendency  is  especially  conspicuous  in  the  results 
of  the  logistic  model  This  comes  from  the  fact  that  the  MLE  bias  functions,  which  are  presented  in 
Figure  6-7  for  both  models,  have  tiny  ups  and  downs,  and  they  are  not  strictly  increasing  in  6  . 

We  notice  that  in  each  of  the  examples  given  above,  the  difficulty  parameters  of  these  items  in  each 
test  distribute  widely  over  the  range  of  B  of  interest,  as  we  can  see  in  Tables  3*1  through  3-3.  This  fact 
is  the  main  reason  that  the  MLE  bias  function  assumes  relatively  small  values  for  a  wide  range  of  B  , 
and  that  the  resulting  two  modified  test  information  functions  are  reasonably  close  to  the  original  test 
information  function.  For  the  sake  of  comparison.  Figures  6-10  and  6-11  present  the  MLE  bias  function 
and  the  square  roots  of  the  original  and  the  two  modified  test  information  functions,  respectively,  for  a 
hypothetical  test  of  thirty  equivalent  items  with  the  common  item  parameters,  =  1.0  and  bg  =  0.0  , 
following  the  logistic  model.  We  can  see  in  Figure  6-10  that  the  amount  of  bias  increases  rapidly  outside 
the  range  of  B  ,  (—1.0, 1.0)  .  The  resulting  square  roots  of  the  two  modified  test  information  functions 
demonstrate  substantially  large  decrements  from  the  original  outside  this  interval  of  ^  ,  as 

we  can  see  in  Figure  6-11. 

We  also  notice  that  in  all  these  examples  there  are  not  substantial  differences  between  the  results 
of  the  two  modification  formulae.  This  indicates  that  in  these  examples  it  does  not  make  so  much 
difference  if  we  choose  Modification  Formula  No.  1  or  Modification  Formula  No.  2.  We  should  not 
generalize  this  conclusion  to  other  situations,  however,  until  we  have  tried  these  modification  formulae 
on  different  types  of  data  sets. 


VII  Effect  of  the  Modifications  of  the  Test  Information  Func¬ 
tion  in  Efficiency  in  Computerized  Adaptive  Testing 

Amount  of  test  information  can  be  used  effectively  in  the  stopping  rule  of  the  computerised  adaptive 
testing.  A  procedure  may  be  to  terminate  the  presentation  of  a  new  item  out  of  the  itempool  to  the 
individual  examinee  when  f(B)  has  reached  an  a  priori  set  amount  at  the  current  value  of  his  estimated 
B  . 


We  notice  that  for  the  stopping  rule  in  computerised  adaptive  testing  the  modified  test  informations 
will  serve  better,  for  in  many  cases  our  itempool  is  limited,  and  especially  for  examinees  whose  ability 
levels  are  close  to  the  upper  or  the  lower  end  of  the  configuration  of  the  difficulty  parameters  of  the 
items  in  the  itempool  there  are  not  so  many  optimal  items.  In  such  a  case,  even  if  the  amount  ot  test 
information  has  reached  a  certain  criterion  level  it  does  not  mean  that  their  ability  levels  are  estimated 
with  the  same  accuracy  as  those  of  individuals  of  intermediate  ability  levels,  as  was  observed  in  Section 
1.  Since,  taking  the  MLE  bias  function  into  consideration,  the  two  modified  test  information  functions, 
T(9)  and  S(8)  ,  are  based  upon  a  more  meaningful  minimum  bound  of  the  conditional  variance  and 
upon  a  minimum  bound  of  the  mean  squared  error  of  the  maximum  likelihood  estimator,  respectively, 
they  will  be  effectively  used  as  stopping  rules  in  computerised  adaptive  testing,  especially  for  individuals 
of  lower  and  higher  ends  of  ability  levels. 

Since  the  test  information  function  7(8)  and  its  two  modification  formulae,  T(8)  and  E(8)  ,  are 
likely  to  be  the  ones  exemplified  in  Figure  6-11  in  the  process  of  adaptive  testing,  provided  that  the 
program  for  the  test  is  written  well,  we  should  expect  visible  differences  between  the  results  obtained 
by  using  1(B)  and  one  of  its  modification  formulae,  especially  for  subjects  whose  ability  levels  are  close 
to  the  upper  or  lower  end  of  the  ability  interval  of  interest. 


27 


Thi®  is  one  topic  we  need  to  investigate  in  the  future,  specifying  the  amount  of  improvement  with 
simulated  and  empirical  data  collected  in  computerised  adaptive  testing. 


VIII  Minimum  Bounds  of  Variance  and  Mean  Squared  Error 
for  the  Transformed  Latent  Variable 

Since  most  psychological  scales,  including  those  in  latent  trait  models,  are  subject  to  monotone 
transformation,  we  need  to  consider  information  functions  that  are  based  upon  the  transfomed  latent 
variable.  Let  r  denote  a  transformed  latent  variable,  i.e., 

(8.1)  r  =  ■ 

We  assume  that  r  is  strictly  increasing  in,  and  three  times  differentiable  with  respect  to,  6  ,  and  vice 
versa.  We  have  for  the  operating  characteristic,  •Pfcj(r)  ,  of  the  discrete  item  response  kg  ,  which  is 
defined  as  a  function  of  r  , 

(8.2)  /***,(»■)  =  proh\kg\T\  =  proh\kg\B\  =  Pk,(6)  , 


and  by  local  independence  we  can  write  for  the  operating 


characteristic  of  the  response  pattern,  Py  (r)  , 


(8.3) 


Py{r)  =  n  W  =  n 

k,tV 


k,<y 


As  before,  the  item  response  information  function,  /fc^(r)  ,  is  defined  by 


(8.4) 


«.(')  -  -f;;  ■ 


and  for  the  item  information  function,  Ig  (r)  ,  and  the  test  information  function,  P  (r)  ,  we  can  write 
from  (8.4),  (1.3)  and  (1.8) 


(8.5) 


v;(r)  =  EnAr)p:.{r)  =  ^\-p:,[r)]^\p:,[r)r 


ae 


39, 


and 


(8.6)  /‘(r)  =  ZW  =  . 

respectively.  Let  ry  be  any  estimator  of  r  ,  which  may  be  biased  or  unbiased.  In  general,  we  can 
write 


(8.7)  E(ry  k)  =  r  +  E{t^  -  f  I  »•)  . 

and,  differentiating  (8.7)  with  respect  to  f  ,  we  obtain 
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I 

I 


(».»)  • 

Since  from  (8.3)  we  can  also  write  for  E{Ty  |  r) 

(8.9)  i;(r;  I  r)  =  5;^  r;  i?;(r)  =  5^  r;  /V(«)  . 

V  V 

differentiating  (8.9)  with  respect  to  6  and  following  a  logic  similar  to  that  used  in  Section  2,  we  obtain 

(8.10)  ^£(r;  1  r)  =  -  E[w  1  r)]  l^iV(<»)l 

=  -  E(r^  1  r)]  (^logiV(e)l  JV(e)  . 

By  the  Cram4r-Rao  inequality,  we  can  write 

(811)  \~E[r;r  I  r)]"  <  Var.(r;  J  r)  £:i{^logiV(e)}"l  , 

and  brom  this,  (1.7),  (1.8),  (2.10)  and  (8.8)  we  obtain 

(8.12)  Var.),;|r)  >  |i£(r;  |  r)|’ IIW)" 

-  l|  +  -  '  I  ''(''I"  ■ 

Thus  the  rightest  hand  side  of  (8.12)  provides  ua  with  the  minimum  variance  bound  of  any  estimator  of 
r  .  When  is  an  unbiased  estimator  of  r  ,  the  second  term  of  the  first  factor  of  the  rightest  hand 
side  of  (8.12)  equals  lero,  and  by  virtue  of  (8.6)  the  inequality  is  reduced  to 

(813)  Var.(r;  |  r)  >  i|l)^  (/(ff))-'  =  (/‘(r))'*  . 

For  the  mean  squared  error,  £((t^  —  t)*  |  t)  ,  we  can  write 

(814)  E\{r;,  -  r)2  j  r]  =  Var.(r;  \  r)  +  1£(t;  |  r)  -  r)"  , 
and  from  this  and  (8.12)  we  obtain 

(8.15)  £;|(r;  -  r)»  |  r]  >  [|l  +  ^E{r^  -  r  \  r)]»  [J(e)\-^  +  [£:(r;  |  r)  -  r]*  . 
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IX  Modified  Test  Information  Functions  Based  upon  the  Trans 
formed  Latent  Variable 

The  maximum  likelihood  estimator,  V  >  of  r  ,  can  be  obtained  by  the  direct  transformation  of  the 
maximum  likelihood  estimate,  ■  of  8  ,  i.e., 

(9.1)  9v=t{6v)  . 

Let  B"(tv  \  t)  be  the  MLE  bias  function  defined  for  the  transformed  latent  variable  r  ,  i.e., 

(9-2)  |r)  =  £(n, -r  |r)  . 

FVom  this,  (8.12)  and  (8.15)  we  obtain 

(9-3)  Var.(fv  |  r)  >  +  ^B*(V  I  r)pl7(0)l-‘ 

and 

(9.4)  E\{rv  -  ry  |  r]  >  l|l  +  \  r)p(/(e)]-‘  +  lB*(n,  |  r)]*  . 

The  reciprocals  of  the  right  hand  sides  of  the  above  two  inequalities  provide  us  with  the  two  modified 
test  information  functions  for  the  transformed  latent  variable  r  ,  i.e., 

(9-5)  T*(r)  =  /(tf)(|l  +  As-(v|r)]-»  , 

and 

(9.6)  =-(r)  =  /(fi)  [{|I  +  ±B-(fv  1  r)}’  +  /(S)  {B*(n,  |  r)}=>]-‘  . 

In  the  general  case  of  discrete  item  responses  we  can  write  for  the  MLE  bias  function  B‘[fv  \  t) 
and  its  derivative  with  respect  to  8 

(9.7)  fl*(V  I  r)  =  B{ev  I  «)[|^l-‘  -  (l/2)l/(<»)l-‘l|;l-’  0 

=  B(«v  |0|j  +  (l/2)|/(^)r‘|^  . 

and 

+(i/2)i/(«)ni(»)|^ -/■(*)  1^1 . 

respectively  (cf.  Samejima,  1987).  Thus  we  can  use  (9.7)  and  (9.8)  in  evaluating  the  modified  test 
information  Kinctions,  T*(r)  and  5*(r)  ,  which  are  given  by  (9.5)  and  (9.6). 
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X  Discussion  and  Conclusions 


A  mininram  bound  of  any  estimator,  biased  or  unbiased,  is  considered,  and,  based  on  that,  Modifica¬ 
tion  Formula  No.  1  is  proposed  for  the  maximum  likelihood  estimator,  in  place  of  the  test  information 
function.  A  minimum  bound  of  the  mean  squared  error  is  considered,  and,  based  on  that.  Modification 
Formula  No.  2  in  the  same  context  is  proposed.  Examples  are  given,  and  the  usefulnesses  of  these 
modified  test  infco’mation  functions  in  computerised  adaptive  testing  are  discussed.  These  topics  are 
also  discussed  and  observed  for  the  monotonically  teansformed  latent  variable. 

It  is  expected  that  these  two  modification  formulae  of  the  test  information  function  can  effectively  be 
used  in  order  to  supplement  deficiencies  of  the  test  information  function  in  different  situations.  Results 
are  yet  to  come,  and  the  author  hopes  that  other  researchers  will  also  use  these  functions  in  their  own 
research  and  observe  their  effectiveness. 
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